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CN ■ One of the aims of this paper is to solve an open problem of Lovasz about relations between 

graph spectra and cut-distance. The paper starts with several inequalities between two versions 
of the cut-norm and the two largest singular values of arbitrary complex matrices, exteding, in 
. particular, the well-known graph-theoretical Expander Mixing Lemma and giving a hitherto 

unknown converse of it. 

Next, cut-distance is defined for Hermitian matrices, and, separately, for arbitrary complex 
matrices; using these extensions, we give upper bounds on the difference of corresponding 
eigenvalues and singular values of two matrices, thus solving the problem of Lovasz. 

Finally, we deduce a spectral sampling theorem, which informally states that almost all 
■ principal submatrices of a real symmetric matrix are spectrally similar to it. 
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<N 1 Introduction 

Q\ . 

In 1997, Frieze and Kannan [TT] introduced and studied the cut-norm of matrices; ever since then 
| this parameter kept getting new attention. It has been extended and used for multidimensional 
matrices in [2j and its algorithmic aspects have been studied in [3]. More recently, starting with 
the cut-norm, Lovasz and his coauthors in [T5l [161 [5j [6] denned a measure of similarity between 
graphs, which they called the cut-distance and used to investigate the asymptotics of sequences of 
dense graphs. 

It turned out that the cut-distance is related to many fundamental graph parameters. In par- 
ticular, in [6] , among many other things, it was proved that if two graphs are close in cut-distance, 
then they are close spectrally. Yet, since this specific result did not produce explicit inequalities, 
Lovasz [T7] raised the problem to find the best upper bound on the spectral difference in terms of 
the cut-distance of graphs. 

One of the aims of this paper is to solve this problem and extend it to arbitrary matrices. To 
this end, we start by establishing several tight inequalities between two versions of the cut-norm and 
the two largest singular values of arbitrary complex matrices. As first-hand applications of these 
inequalities we extend the well-known graph-theoretical Expander Mixing Lemma and its converse. 
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In particular, we obtain a new converse of the Expander Mixing Lemma, which is simpler than 
those in El El- 

Next, we extend the concept of cut-distance to Hermitian matrices, and, separately, to arbitrary 
complex matrices; using these extensions, we give upper bounds on the difference of corresponding 
eigenvalues and corresponding singular values of two matrices. 

As an application we deduce a spectral sampling theorem, which informally states that almost 
all principal submatrices of a real symmetric matrix are spectrally similar to it. These result 
complements results of fTS] and [TU] . 

The rest of the paper is organized as follows: in the remaining subsections of the introduction 
we state our main results together with some discussions. All proofs are collected in Section [2j At 
the end, some open question are raised. 



1.1 Notation and definitions 

First we introduce some notation and conventions. For undefined matrix notation we refer the 
reader to [121. We write: 



- M. mj n for the class of all complex matrices of size m x n; 

- 7i n for the class of all Hermitian matrices of size n; 

- V n for the class of all permutation matrices of size n; 

- J m _n for the all ones matrix of size m x n, and set J n = J n>n . 

- (x, y) for the standard inner product in C n ; 

- y <g> x for the m x n matrix [yiXj}, where x = (xi, . . . , x n ) and y = (yi, . . . , y m ) . 
Given a matrix A = [ay] G M. m ,n-, we write: 

- | A | ^ for maxjj |ay| ; 



- || A || F for the Frobenius norm y ■ |a i:) | 2 ; 

- || A || 2 for the operator norm of the linear map A : C™ —>■ C m ; 

- 0i (A) > ■ • • > cr m (A) for the singular values of A; 

- /ii (A) > ■ ■ • > /i m (A) for the eigenvalues of A if A is Hermitian; 

- X (A) for the sum of the entries of A; 

- p{A) for S (A) /inn; 

- A* for the conjugate transpose of A; 

- A [X, Y] for the submatrix of all a^- with % e X, j G Y, where X C [m] , K C [n]. 

Definition 1 Following [77] /. /or every A G A^ m>n , define the cut-norm \\A\\ a of A by 

\\A\\ n = max —\E(A\X,Y])\. 

Xc[m], Vc[n] ffffl 

Definition 2 ^4 similar, yet distinct norm \\A\\^ can be defined by 

II AIL = max |y!(4[yyi)| 

U XC[m], yc[n], X,Y^0 y/\X\ \Y\ 
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The norm \\A\\^ is implicit in numerous papers related to the second singular value and to expan- 
sion of graphs: specifically, when A is the adjacency matrix of a graph, the value \\A — p (A) J„|| Q 
appeared first as the a-parameter in Thomason [2U1EI]; it was developed further by Alon, Chung 
and Spencer [H H], and more recently it was studied in [3 El [9]. 

Note that neither \\A\\ n nor \\A\\^ are sub-multiplicative; therefore, they are not matrix norms 
in the strict sense as defined, say, in [12], Ch. 5. 

1.2 Bounds on cut-norms 

The following two upper bounds on a\ (A) in terms of \\A\\ D and \\A\\ B are the cornerstones of our 
investigation. 

Theorem 3 Let A G M. m ,n- If A is real, then 



a 1 (A)<2 y /\A\ oo \\A\\ D mn ] (1) 

if A is complex, then 



a l {A)<A^\A\ 00 \\A\\ u mn (2) 

and 

a x (A) < C \\A\\ B A/log m log n (3) 

for some positive C < 10 5 \ Inequalities (T7]j, (TJj] and (TJj] are tight up to constant factors. 

Inequalities ([1]) and ([3]) can be inverted to some extent. Indeed, Schur's identity o\ (A) = \\A\\ 2 
implies that 

^)>PII Q , (4) 



and consequently, a\ (A) > \\A\\ n y/mn. 

In turn, inequality (jl]) implies an extension of the Expander Mixing Lemma, including its bi- 
partite version which is implicit in Gowers |14j, Lemma 2.9. For convenience, we restate this 
graph-theoretical result: 



Let G be a bipartite graph with vertex classes U and V, and let A be its biadjacency matrix. 
Suppose that G is semiregular, i.e., vertices belonging to the same vertex class have the same degree. 
Then 

o~2 {A) > max 



SCU, RCV, S,R^0 ^\S\ \R\ 

Here e (X, Y) stands for the number of edges uv such that u G X,v EY. The theorem below extends 
the Expander Mixing Lemma to any matrices. Note that for nonnegative matrices essentially the 
same result has been obtained by Butler in [9], Theorem 1. 

For x = (xi, . . . , x n ) G C n , y = . . . , y m ) G C m , write y ® x for the m x n matrix [yiXj] . 
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Theorem 4 Let A G Ai m .n o,nd let x G C n , y G C m 6e two unit vectors such that <j\ (A) = (Ax, y) . 
Then 

0-2 (A) > \\A-a 1 (A)y®x|| H . 
In particular, if A is a nonnegative matrix with equal row sums and equal column sums, then 

o- 2 (A) > \\A-p(A) J m ,n\\ B . 

Along this line, inequalities ([I]) and (j3J) imply the following upper bounds on cr 2 - 

Theorem 5 For every A G M. m ,n we have 



o- 2 (A) <4yJ\\A-p(A) J m , n \\ D mn (5) 

and 

a 2 (A) <C\\A — p(A) Jm,n\\ B A/logmlogn (6) 

for some positive C < 10 5 . Inequalities (EJ) and (f^j are ii^/ii to constant factors. 

In the above general matrix setup, inequality ([6]) is new, but for Hermitian matrices it is known 
from [Sj. For regular graphs somewhat better results were obtained by Bilu and Linial [7j, and for 
nonnegative matrices, by Butler [9]. On the other hand, inequality (jSJ) is entirely new; while it 
seems less subtle than (jBJ), it is much easier to use. 



1.3 Extending the cut-distance to complex matrices 

Following the general idea of cut-distance for graphs, we shall define cut-distance for arbitrary 
matrices. Note that, in fact, Lovasz and his coauthors have defined the cut-distance for real mea- 
surable functions / : [0, l] 2 — * R, in particular for real symmetric matrices. For Hermitian matrices 
we follow their footprints, but for arbitrary complex matrices we make a necessary adjustment, 
producing in fact a slightly different version of the cut-distance, even for graphs. 



The cut-distance of Hermitian matrices 

Given A = [a^] G TL n and integer p > 1, let 

A® = A ® J p , 

where ® denotes the Kronecker product. Thus, A^> is obtained by replacing each entry with 
the matrix a^J p . Note that A&) G 7i np . Now, for every A, B G TC n , define 5\j (A, B) as 

h(A,B) = mm {\\A - PBP- l \\ u : P eV n } . 

Finally, extend the function 8u {A, B) to matrices of different sizes as follows: for every A G 7i n 
and B G TCm, define the cut-distance Sn (A, B) as 

S D {A, B) = Urn 5 D (A (km \ B (kn) ) . 

k— >oo 
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It is not immediate, but is rather simple to see that the limit above exists, and moreover, 

6 n (A, B) = inf ?□ (A {km \ B {kn) ) . 

Note also that the function S B (A, B) is symmetric and satisfies the triangle inequality 

So (A, B) < S D (A, C) + S D (C, B) 

for all Hermitian matrices A, B, C. However, 5a (A^ p \ A^^j = 0, and so, So (-, •) is not a true metric, 
but only a pre- metric. 

The cut-distance of arbitrary matrices 

The matrix setup allows an easy modification of #□(•,•) for arbitrary complex matrices. Given 
A = [aij] G M. m ,n and two positive integers p, q, let 

j^^Pil) — (gj Jpq- 

Note that A^^ G M mpm - Now, for every A, B G M m>n , define <5 B (A, 5) as 

5a (A, B) = min{||A - PBQ\\ U : P e V m , Q e V n } 

Finally, extend the function 5a (A, B) to matrices of different sizes as follows: for every A G M. m ,n 
and B G A4 r ,s, define 5a (A, B) as 

5a (A, B) = lim 5 B (A {kr > ks \ B (km ' kn) ) . 

k— >oo 

As in the case of Hermitian matrices, the above limit exists and we have 

5 B (A, B) = mfS B (A {kr ' ks \ B {km > kn) ) . 

Also, the function £□(■,■) is symmetric and satisfies the triangle inequality, but is only a pre- metric. 

Note that now, for Hermitian matrices we have two cut-distances: £□(-,•) and <5b (•,•). It is not 
difficult to prove that 

5a (A, B) < 5a (A, B) < 25 B (A, B) 
for every two Hermitian matrices A and B. 

1.4 The spectral difference of matrices 

Having inequality (pQ) and the definition of #□(•,•) in hand, we can bound the difference of corre- 
sponding eigenvalues of two Hermitian matrices A and B in terms of 5a {A, B) . The main difficulties 
here come from the fact that A and B can be of different size and consequently have a different 
number of eigenvalues. But even when A and B are of the same size, there may be complications 
due to a huge difference in the number of their positive eigenvalues. Thus, the theorem below gives 
two conclusions from the same premise: one when eigenvalue signs are taken into account (clauses 
ii.a and ii.b), and one when they are not (clause i ). 
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Theorem 6 Let n > m > 1, and let A £ 7-^ n , i? G 7Y m satisfy {Al^ = l-Bloo = 1- 27ien 
(%) /or euen/ i = 1, . . . , |~m/2] , we have 



Hi (A) in (B) 



n m 
(A) 



n 



< 



< 



6fa (A, B) 



+ 



+ 6S n {A, B) 



1/2 



1/2 



(ii.a) if fii (A) > and /ij (5) > 0, then, 

Hi (A) ^ (B) 



n 



in 



< 6S n (A, B) 



1/2 



(ii.b) if fii (A) < and /ij (B) < 0, then 

{A) 



n 



m 



< 6S n (A, B) 



1/2 



Since in clause (i) of the above theorem eigenvalue signs are not taken into account, the undesired 
term (n/2) _1/2 + (m/2) _1/2 appears in the right-hand side. In general, this term seems unavoidable: 
indeed, taking A = B^ k \ we have 5\j (A, B) = 0, but the difference 

IH (5 (fc) ) ih (B) 



mk 



m 



can be as large as m 1 ^ 2 /2, say when B is a Paley graph of sufficiently large order m and i 
\m/2] + 1. 

Fortunately, for singular values, everything goes smoothly. 



Theorem 7 Let A £ M. m ,n and B E A4 r ,s satisfy \A\ 
1, . . . , min (m, n, r, s) , we have 



\B\ 



1. Then for every i 



Oi (A) ^ (B) 



'mn 



rs 



< 65 B (A, B) 



1/2 



Remark. If the matrices in Theorems [6] and [7] are real, the coefficient 6 in the right-hand side 
can be replaced by 3. 



1.5 Matrix sampling 

Alon, de la Vega, Kannan and Karpinski [2] came up with a powerful matrix sampling result, further 
improved by Borgs, Chayes, Lovasz, Sos, and Vesztergombi in [5], Theorem 2.9; for convenience we 
restate it in a slightly weaker form: 
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Let n > k > 1 and let A be a real symmetric matrix of size n. Let B = A [X, X] , where X is a 
uniformly random subset of [n] of size k. Then 



6 n (A,B)<10\A\ oo (log 2 k) 



-1/2 



with probability at least 1 — exp {—k 2 / (2 log 2 k)) . 

In view of this theorem, we can use Theorems [6] to derive a spectral sampling theorem for real 
symmetric matrices. There is a rich literature dedicated to this topic, see, e.g., the references of 
[18J ; we shall mention only two recent milestones: Chatterjee and Ledoux [TO] proved that almost 
all principal submatrices of a Hermitian matrix A have empirical eigenvalue distribution close to 
the expected eigenvalue distribution. Prior to that, Rudelson and Vershynin [18] have obtained 
more precise results, but only for the singular values of special submatrices. Here we take an 
intermediate approach. We prove a sampling result about principal submatrices of real symmetric 
matrices, bounding all eigenvalues of the sample submatrix, but not attempting the level of precision 
as in [TBj. In addition, our methods are much simpler than the methods of pi)] and |18j . 

Theorem 8 Let n > k > 1 and A be a real symmetric matrix of size n. Let B = A [X, X] , where X 
is a uniformly random subset of [n] of size k. Then with probability at least 1 — exp (~k 2 / (2 log 2 k)) , 
for every i = 1, . . . , k, we have 
(i) if Hi (B) > 0, then 



IH (A) m (B) 



n 



<30 (log 2 fc)' 



-1/4 



(ii) if Hi(B) < 0, then 



(in-k+i {A) Hi (B) 



n 



k 



<30 (log 2 A;)- 1/4 . 



2 Proofs 

2.1 Proof of Theorem [3] 



For the proof of inequality (jTJ we need a standard lemma that can be traced back to [UJ. We prove 
it here for convenience. 



Lemma 9 Let A e M m , n , x G W 1 , y G W m . Then 

\(Ax,y)\ <4||x|| 0O ||y|| 0O P|| n mn. 

//x G C™, y G C m , then 



|<i4x,y)|<16||x||J|y lle , 



□ 



mn. 



(7) 
(8) 



7 



Proof Assume for simplicity that ||x|| = Hyll^ = 1. We shall prove first ([7]). Since (Au,v) 
maps the cube [—1, i] m+ra linearly in each coordinate of u and v, max \{Au, v)| is attained for some 
u' = «, . . . , <) G {-1, l} n , and v' = «, ...,<) e {-1, l} m . Set 

i?+ = { x : < = 1} , iT = {x : < = -1} , 
C + = {x:u' x = l}, C~ = {x:u' x = -l}. 

Now we see that 

\(Au',v')\ = \Z(A [R + ,C + ])+Z(A [R-,C-])-Z(A [R + , C~]) - E (A [iT,C + ])| 

< |E (A [i? + ,C + ])| + |E (A + |E (A [R + ,C-])\ + |E (A [R~,C + ])\ 



< 4 



□ 



ran. 



completing the proof of (jTJ). 

To prove (jHJ), suppose that x = (x±, 



x r< 



(y 



y m ) , and set 



x = (Re xi, . . . , Re x n ) , x x = (Im xi, . . . , Im x n ) , 
y = (Re . . . ,Rey m ) , y x = (Imyi, . . . ,Imy m ) . 



We have 



\{Ax,y)\ = |(Ax ,y ) - (Axo,yi)i+(Axi,y )z + (>lxi,yi)| 

< |(Ax ,y )| + |(Axo,yi)| + {(Ax^yo)] + |(Ax 1)yi )| . 

Since Xo,Xx,yo,yi are real, inequality ([S]) follows from ([7]). 

For the proof of ([3]) we need the following lemma, proved in [5]. 

Lemma 10 Let p > 1, n > 1 and < £ < 1. T/ien /or ever?/ x = (xi, 
there is a vector y = (yi, . . . , y n ) G C™ such that jji take no more than 



□ 



X n ) G C™ Itfii/l llxl 



'8tt' 



4 , An 
-log — 



values and ||x — y|| < e. 



Proof of inequalities (J2J) and flTJ) We shall prove first P). Let A = [ay], A* = [a*-] , A* A = [Zy . 
For every j G [n] , set 

Cj (^ij, 0,2ji ■ ■ ■ i Q<mj) ■ 

Select % G [n] so that Y^je\n] * s m aximal. It is well-known that 

o${A)=fr (A* A) < \bij\ ■ 
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Note also that 

bij = a ik a kj — a kj a ki = ( c j, c i) 

fc£[m] kG[m] 

For every j G [n] , set 

Kcj,c<)|/<Cj-,Ci) if (c^q) ^ 



Xj 



if( Ci , Ci ) = 

and let x = (x%, . . . , x n ) . Also for every k G [m] , set z/^ = a ki and let y = (yi, . . . , y m ). Note that 

j'G[n] j'G[n] je[n] fee[m] fce[m]je[n] 

Since jy^ < 1, in view of (jHJ), we see that 

(Ax, y) < 16 ||A|| n IxL ly^ = 16 |L4|| n 1^ , 

completing the proof of inequality <$fy. 

Inequality (pQ) follows likewise, using (j7j) instead of (JHD- 

To prove that inequality (JTJ) is tight, define a square symmetric matrix A = [ay] of size 2n + 1, 
by letting 

'1 if 2 < i < n + 1, 
-1 if n + 1 < i < In + 1 



Qli — Oil 



and let all other entries of A to be 0. We easily find that <j\ (A) = \^2n. Also \\A\\ n (2n + l) 2 = 2n, 
for if X C [2n + 1] , Y C [2n + 1] are such that |S (A [X, Y])\ is maximal, the only contributions 
to |S (A [X, Y])\ come from the first row and the first column, and each of them can be at most n. 
Thus, we have 

a\ (A) = 2n = \A\ oo \\A\\ a (2n + l)\ 
and so inequality ([1]) is tight up to a factor of 2 and inequality ([2]) is tight up to a factor of 4. □ 

Proof of inequality §5§ By Schur's identity o"i (A) = ||A|| 2 , there exists unit vectors x = 
(xi, . . . , x n ) G C" and y = . . . , y m ) G C m such that 

cri (A) = (Ax,y). 

Applying Lemma [TU1 with e = 1/3, we can find vectors 

x.' = {x[,...,x' n ) = y'= (y[,...,y' m ) 

such that 2^ take p distinct values oti, . . . , a p and y[ take q distinct values . . . , (3 q , and 

||x-x'|| < 1/3, 

lly-y'll < 1/3, (9) 

p < 12 [247r] [log 12n] = 912 [log 12n] , (10) 
5 < 12 [24tt] [log 12m] = 912 [log 12m] . 
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For every i G [p] , j G [g] , let 

Ni = {u : x' u = at} , 
Mj = {u:y' u = l3 3 }. 

Clearly, N\ U • • • U N p and M\ U • • • U M q are partitions of [n] and [m] . 
Our first goal is to prove that 



*i (A)<^|(Ax',y' 



Indeed, we have 



|<Ax,y> - (Ax',y'}| = |(Ax,y> - (Ax',y> + (Ax',y> - (Ax',y'}| 

< |(A(x-xO,y)| + |(Ax',y-y')| 
<a x (A)(||x-x'|| ||y|| + ||x'|| Hy-y'll) 

< a x (A) (||x - x'|| ||y|| + (||x|| + ||x - x'||) ||y - y' 

<a 1 (A)(2 + l) 1 -< 7 ri (A), 



implying that 



\a, (^l-KAx',/)^-^ (A) 



and inequality ffTTl) follows. 

Now, define the matrix C = [cy] G M. PA by 



For every i G [p] , j G [g] , set = a/I^K, tj = \f\ M j\Pj and let t = (ti, 
Clearly ||s|| = ||x'|| and ||t|| = ||y'|| . Also, we see that 



\(^',y')\ 



i=l 3=1 
V <? 

j=l i=l 

<<n (C)f||x|| + 



P 9 



S S ^ / | M .| I AT I S S a ™ 

j=i i=i V l iV il ueMiveNj 



<ai (C) ||s|| ||t|| = ai (C)||x'|| ||y' 



1 



16 



C7! (C) 



Hence, in view of fTTTT) . ([9]) and (jTUI) . we see that 



en (A) < 8(7! (C) < ||C|| F < 8^ max |c#| 

ij'£[m] 



< 8 • 912v/logl2ra log 12m 



□ 
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To complete the proof of ([3]) assume that n > 2 and m > 2 and observe that 

8 ■ 912v/logl2nlogl2m < 8 • 912^(10 In 12 + l)0ognlog 

< 10 5 A/lognlog 



m. 



To prove that inequality (J3j) is tight up to a constant factor, define a square symmetric matrix 
A = [a,ij] of size n by letting a%j = {ij)~ 1 ^ 2 . Set s n = Ya=i V*- ^ * s eas Y to see that the vector 
x = (x\, . . . , x n ) , where = (is n )~^ 2 is of length 1 and thus satisfies, 



n n ^ 

(7i (A) > (Ax, X) = — = S n > log 71. 



,=1 i= l V«» 

On the other hand, let X C [n] , K C [n] be such that 

||A|| B = -pi — [E(A[x,y])| 
D v/|x| jyj 

Clearly X = [p] , y = [g] for some p, g <G [n] . We thus have 

p 9 



Hence, 

(Ti (A) > logn > -41ogn > - || A\\^ logra, 
and so, inequality fl3]) is tight up to a constant factor. □ 



2.2 Proofs of Theorems [4] and [5] 

Proof of Theorem [3] The proof is essentially a tautology of the singular value decomposition 
theorem (see, e.g., [12], Ch. 7). Let 

m 

A = a x (A)y®x+£V i (A)yi®x < 

i=2 

be a singular value decomposition of A, where y, y 2 , . . . , y m € C m are unit orthogonal left singular 
vectors and x, x 2 , . . . , x m 6 C n are unit orthogonal right singular vectors to en (A) , cr 2 (A) , . . . , a m (A) . 
Hence, 

m 

A - en (A) y <g> x = °i ( A ) ^ ® x " 

and so, 02 (A) = en (A — ax (A) y ® x) . Now PJ) implies that 

a 2 {A) — ax (A - en (A) y ® x) > || A - en (A) x ® y|| H . 
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If A is nonnegative and its row sums are equal and its column sums are equal, then we can choose 

1 1 



and so, 

a x (A)y ®x = p(A) J m>n , 
completing the proof. □ 

Proof of Theorem [5] Weyl's inequalities for singular values (see, e.g., [13J, Theorem 3.3.16) state 
that 

a 2 (X + Y) < a 1 (X) + a 2 (Y) . 

Setting Y = p (A) J mi „, X = A — Y, and noting that a 2 (Y) = 0, inequalities §5§ and ([HD follow from 
([1]) and ([3]) respectively. 

To see that inequality is tight, define the square symmetric matrix B = [6^] of size n by 
letting bij = (ij)~ 1/ ' 2 , and set 

J n + B J n — B 
J n — B J n + B 



A 

Clearly p (A) = 1, and so 



B -B 
-B B 



A-p(A) J 2n = 

As shown in the proof of Theorem [3], H-B^ < 4, and so 

\\A- p(A)J 2n \\ B < 4 \\B\\ B < 16. 

On the other hand, a± (A) = p\ (A) = 2n, and the all ones vector is an eigenvector to p± (A) . It is 
easy to check that the 2n-vector 

(l,2-V\...,n-^,-l,-2-V\...,-n-^), 

is an eigenvector of A to the eigenvalue 2 J^" Hence, 

n i 
02 {A) > 2^1/z > 21ogn > - \\A- p{A)J 2n \\ B V*og n log n . 

i 

and so (EI) is tight up to a constant factor. □ 



2.3 Proof of Theorem M 

The following two facts are derived by straightforward methods. 

Proposition 11 Let A £ H n and k > 2. Then the eigenvalues of A^ are kpi (A) , . . . , kp n (A) 

together with (k — 1) n additional O's. 
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Proposition 12 Let A e Ai m .n andp,q > 2. Then the singular values of A^ p ' q ^ are 

y/pq^i {A),..., y/pqcr m (A) 

and the rest are zeroes. 

For the proof of Theorem [6] we shall show that the extremal k eigenvalues of A^ are roughly 
proportional to the corresponding eigenvalues of A. 

Lemma 13 Let k > 2. Then for every i = 1, . . . , n, 

)< M^_^) < 

kn n ny/n — i+l 

Q> Mn-i+i(AW) <Ura _ m (A) > || A|| F 

~~ tn n ~ n\/n — i + l' 

Proof We shall prove only ffl2l) ; inequality ffT31 follows likewise, applying (fT2l to —A. Note that 
Proposition [12] implies that A^ k ' and A have the same number of positive eigenvalues. If Hi (A^ k n > 
0, then fii (A) > and Hi (AW) = k^ {A) , so (H2D holds. If Hi < 0, then Hi (A) < and so 

> m {A) > ■ ■ ■ > ii n (A) . 

Hence, inequality (fT2"j) follows from 

{n-i + l)rf{A)<f^ti{A)<\\A\\ 2 F . 

j=i 

□ 

Proof of Theorem[6]Let k be a positive integer. By the definition of (-,-), there is a permutation 
matrix P G V mn k such that 



In • 



'do {A mk \ B^ nk ^ = llA*™ 1 ^ — p_g( nfc )p _1 | 
Referring to [13], Theorem 3.3.16, we have 

(A {mk) ) - ^ {B (nk) ) 1 = 1/1, (A (mk) ) - ^ (PB^P- 1 ) | < o~ \ (A (mk) - PB^P' 1 ) 
Now, inequality (j2J) implies that 

|/Xi (A (mfc) ) - Hi {B (nk) ) | < o-i {A (mk) - PB^P- 1 ) 



< 4W2 ||A( mfc ) - PB^P- 1 1| D mnfc 



< 6 W 5 D (A( mfc ), B( nk ))mnk. 
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and so 



l — \ta (A {mk) ) - m (B {nk) ) I < Q^5 a (A( mk KB( nk )) 



mnk 



(14) 



To prove (i), note that the triangle inequality and Lemma [TBI imply that 



Hi (A) fa (B) 



n 



m 



< 



m (A) & (a^) 



n 



mnk 



< 



\A\ 



+ 
B\\ 



m (B) & (fl<»*>) 



m 



mnk 



mnk 



mnk 



< 



n\Jn — % + 1 my/m — i + 1 
1 1 



6\f5 n (A( mk \B( nk )) 



+ 6V<5 n (A( mk ),B( nk )). 



\fn — i + 1 \Jm — i + 1 
Letting k tend to infinity and passing to limits in the above inequality, we obtain 



Hi (A) m (B) 



1 1 

< + 



n m 
Hence, for every i = 1, . . . , \m/2] , 

Hi (A) m (B) 



\fn — i + 1 \Jm — % + 1 



+ ev / W). 



n m 
(A) 



n 



m 



< 



< 



VW2 



L= + 6y/6 n (A, B), 



^n~j2 



L= + 6y/5 n (A, B). 



Now let us prove (ii.a). Suppose that \ii (A) > and \ii (B) > 0. Then using Proposition [TT1 and 
(ED , we find that 

/ii (A) /ii (B) 



mnk 



\fj,i (A (mk) ) - fa (B (nk) ) | < 6J6 n (A( mk \ 



Letting tend to infinity and passing to limits (ii.a) follows. The clause (ii.b) follows by a similar 
argument. □ 

Proof of Theorem [7] The proof is a straightforward modification of the proof of Theorem O Let 
k be a positive integer. By the definition of 5b (•, •) , there exist permutation matrices P G V mn k 
and Q G P rs fc such that 



!□ ■ 



^y^(rfc,sfc) j^(mk,nk)~^ ||^(rfe,sfe) p p(mk,nk) q | 

Since <t< (bC™*^)) = a, (PB^ mk ' nk ^Q) , referring to the inequality 

h(X)-a, (y)| <t7! (X-Y), 
(see, e.g., [13], Theorem 3.3.16,), we obtain 

\<n (A {rk ' sk) ) - a t (B (mk ' nk) ) \<\<Ti (A {rk ' sk) ) - Oi (PB (mk ' nk) Q) \ < o x (A {rk ' sk) - PB (mk ' nk) Q) . 
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Now, inequality (J2J) implies that 

|<Zj (A (rfc ' sfc) ) - o"j (5( mfe ' nfc ^) I < a 1 [A {rKsk) - PB {mk ' nk) Q) 



< AkJ2 \\A( rk ' sk ) - PB( mk > nk )Q\\ D mnrs 



< Gky 5 B (A( rk > sk \ B( mk > nk )) mnrs, 



and so, 



— \(n (A^ sk) ) - (n (B( mk > nk A I < 6\/s B {A( rk ' sk ),B( mk 

ky/mnrs 1 1 v 



nk)^ 



Finally, using Proposition [121 we find that 



<n (A) a, (B) 



— j k (A irk ' sk) ) - <n (B<- mk > nk A \ < 6\/5 B (A( rk > sk ),B( mk > nk )). 

ky/mnrs v 



/mn yrs 

Letting /c tend to infinity and passing to limits, the proof is completed. 



□ 



2.4 Proof of Theorem M 

Proof of Theorem [8] Let X be a uniformly random subset of [n] of size k. Let B = A [X, X] . The 
result Borgs et al. implies that 

5d [A,B)<10\A\ oo 0og 2 k)- 1/2 

with probability at least 1 — exp (—k 2 / (21og 2 k)). 

By Cauchy's Interlacing theorem, for every i — 1, . . . , k, 

Hi {A) > m (B) > Hn-i+i (A) . 

Hence, if Hi (B) > 0, then Hi (A) > 0, and clause (ii.a) of Theorem [6] implies that 



Hi (A) ^ (B) 



n 



k 



< 35 n (A, B) 1/2 < 301^1^(^2 k) 



-1/4 



If Hi (B) < 0, then Hn-i+i (A) < 0, and clause (ii.b) of Theorem [6] implies that 



Hn-k+i 

(G) Hi (H) 



n k 
completing the proof of Theorem [SJ 



<S8 u {A,Bf' 2 <W\A\ {\og 2 k) 



-1/4 



□ 
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Concluding remarks 



1. Note that the norm \\A\\ B seems subtler than ||A|| n . Yet while \\A\\ n was used in a successful 
version of Szemeredi's Regularity Lemma ([H]), \\A\\ a has never been studied explicitly in 
this respect. A natural question arises: what type of Regularity Lemma one can prove using 

2. Let A G M. m .n and B G M. p , q - We studied the spectral difference of A and B in the form 

c?i (A) a t (B) 



max 

l<j<min(p, q, m,n) 



'mn 



On the other hand, the vector of the singular values of a matrix A becomes a unit vector 
when divided by \\A\\ F . Thus, it seems more appropriate to study 



max 

l<i<min(p, q, m,n) 



<Ti {A) a t (B) 



B 



\F H^HF 

Can Theorem [7] be modified accordingly? Similar modifications seem possible for the eigen- 
values of Hermitian matrices. 

3. Some, but not all, of our results can be extended for complex graphons, i.e., measurable 
functions / : [0, l] 2 — > C. One way of doing this is approximation by step functions with 
finitely many steps. We leave these extensions to interested readers. 
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